RBF interpolation and Gaussian process regression through an RKHS formulation
نویسندگان
چکیده
Radial Basis Function (RBF) interpolation is a common approach to scattered data interpolation. Gaussian Process regression is also a common approach to estimating statistical data. Both techniques play a central role, for example, in statistical or machine learning, and recently they have been increasingly applied in other fields such as computer graphics. In this survey we describe the formulation of both techniques as instances of functional regression in a Reproducing Kernel Hilbert Space. We then show that the RBF and Gaussian Process techniques can in some cases be reduced to an identical formulation, differing primarily in their assumptions on when the data locations and values are known, as well as in their (respectively) deterministic and stochastic perspectives. The scope and effectiveness of the RBF and Gaussian process techniques are illustrated through several applications in computer graphics.
منابع مشابه
Generalization of the Kimeldorf-Wahba correspondence for constrained interpolation
In this paper, we extend the correspondence between Bayes’ estimation and optimal interpolation in a Reproducing Kernel Hilbert Space (RKHS) to the case of linear inequality constraints such as boundedness, monotonicity or convexity. In the unconstrained interpolation case, the mean of the posterior distribution of a Gaussian Process (GP) given data interpolation is known to be the optimal inte...
متن کاملA New Composition Method of Admissible Support Vector Kernel Based on Reproducing Kernel
Kernel function, which allows the formulation of nonlinear variants of any algorithm that can be cast in terms of dot products, makes the Support Vector Machines (SVM) have been successfully applied in many fields, e.g. classification and regression. The importance of kernel has motivated many studies on its composition. It’s well-known that reproducing kernel (R.K) is a useful kernel function ...
متن کاملGenomic Prediction of Genotype × Environment Interaction Kernel Regression Models.
In genomic selection (GS), genotype × environment interaction (G × E) can be modeled by a marker × environment interaction (M × E). The G × E may be modeled through a linear kernel or a nonlinear (Gaussian) kernel. In this study, we propose using two nonlinear Gaussian kernels: the reproducing kernel Hilbert space with kernel averaging (RKHS KA) and the Gaussian kernel with the bandwidth estima...
متن کاملIvanov-Regularised Least-Squares Estimators over Large RKHSs and Their Interpolation Spaces
We study kernel least-squares estimation under a norm constraint. This form of regularisation is known as Ivanov regularisation and it provides far better control of the regression function than the well-established Tikhonov regularisation. In particular, the smoothness and the scale of the regression function are directly controlled by the constraint. This choice of estimator also allows us to...
متن کاملStable Computations with Gaussian Radial Basis Functions in 2-d
Radial basis function (RBF) approximation is an extremely powerful tool for representing smooth functions in non-trivial geometries, since the method is meshfree and can be spectrally accurate. A perceived practical obstacle is that the interpolation matrix becomes increasingly illconditioned as the RBF shape parameter becomes small, corresponding to flat RBFs. Two stable approaches that overco...
متن کامل